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Previous research has shown that in a simulated flight task, navigating a path defined by ground markers 
while maintaining a target altitude is more accurate when an altitude indicator appears in a virtual scene- 
SS- ho». symbology moving as if i. warn pan of Urn 

compared to the fixed-location, superimposed format found on present-day HUDs (Foyle, McCann& 

Shelden 1995). One explanation of the scene-linked performance advantage is that attention can be divided 

between’ scene-linked symbology and the outside world more efficiently than between standard (fixed- 
position) HUD symbology and die outside world. The present study tested two alternative cxpl^uons by 
manipulating the location of the scene-linked HUD symbology relative to the ground pa* makers. Scene- 
linked symbology yielded better ground path-following performance than standard fixed-locauon 
superimposed symbology regardless of whether the scene-linked symbology appeared directlyalong the 
gr^nd path or it various distances off the path. The results support the explanation that the performance 
benefits found with scene-linked symbology are attentional. 


INTRODUCTION 

Piloting an aircraft consists of many subtasks. For 
example, at any given moment the pilot might be trying to 
navigate a path, maintain a particular altitude, visually scan 
the environment, and monitor radio transmissions. In order to 
accomplish these tasks, the pilot must process many stimuli 
(e.g., the landscape, gauges, auditory messages). From a 
psychological standpoint, each processing demand places an 
af piitinnal load on human attention. Because the capacity of 
human attention is limited, an important goal of human 
factors researchers is to design displays that minimize the 
information processing demands on the operator. 

One method widely thought to reduce the effort needed to 

acquire flight- relevant information from cockpit instruments is 
to project information normally found on head-down 
instrument panels onto a Head-Up Display (HUD). A HUD is 
a collimated, transparent display medium upon which 
instrument symbology is shown directly superimi»sed on the 
out-the- window scene. HUDs were designed to eliminate the 
need to refocus the eyes with their collimated optics, and the 
need for large eye-scan movements between the out-the- 
window view and the instrument panel, since the out-the- 
window scene and the HUD symbology can be placed near one 

another. In addition, the direct superimposition of HUD 

symbology on the outside world makes it physically possible 
for the pilot to process both sources of information 
simultaneously. 

Although flight-related performance benefits using HUDs are 
well documented (e.g., Boueek, Pfaff & Smith, 1983; Marun- 
Emerson & Wiekens, 1997), recent results call into question 
whether superimposed HUD symbology facilitates the joint 
processing of instrument symbology and the out-the-window 
scene. In a simulated landing experiment, Wiekens and Long 


(1995) found that pilots took longer to notice a potential 
runway incursion and initiate a go-around when using a HUD 
compared to a head-down panel display (also see Fischer, 

Haines & Price, 1980). These results suggest that, despite the 
design goal of HUDs, pilots did not maintain simultaneous 
awareness of HUD symbology (what Wiekens calls the "near 
domain") and the out-the-window scene (the "far domain”). 
Furthermore, in a terrain flight simulation, Foyle, McCann 
and Shelden (1995) had subjects perform two continuous, 
simultaneous tasks in wind turbulence conditions: Follow a 
path defined by a winding series of ground-markers and 
maintain a target altitude of 100 feet In one condition, the 
no-gauge baseline condition, current altitude had to be 
estimated using only the natural, perspective cues in the out- 
the-window scene (e.g., ground objects varied in size as a 
function of altitude). In another condition, these natural, 
perspective cues were supplemented by a HUD- like readout 
(digital or analog) of current altitude superimposed at a fixed 
location on the screen. Not surprisingly, subjects were better 
able to maintain the target altitude when an altitude gauge was 
present than when it was absent. This improvement in 
altitude maintenance, however, was accompanied by an 
associated induction in path-following accuracy. Path- 
following performance was worse when a fixed-screen location 
superimposed altitude gauge was present than when it was 
absent. Foyle, McCann and Shelden (1995) referred to this 
performance pattern as the altitude/path performance tradeoff. 

One explanation of both the Wiekens and Long (1995) 
findings and the Foyle, McCann and Shelden (1995) tradeoff is 
that they reflect limitations of human visual/spatial attention. 
There is considerable evidence to suggest that, while it is 
possible to divide attention among stimuli that group together 
on the basis of salient perceptual characteristics (e.g., common 


motion, color, shape), it is difficult to divide attention across 
stimuli belonging to separate perceptual groups (Kahneman & 
Henik, 1981). There are a number of salient visual cues that 
would bias the visual system to parse the HUD as one 
perceptual group, and the world as another. For example, 
most HUD symbology is stationary (i.e., appearing at a fixed 
location on the display) whereas elements in the far domain 
appear to be in continual motion with respect to the observer 
in a moving aircraft. Assuming this parsing/grouping of the 
near and far domains occurs, it would discourage or prevent 
attention from being efficiently divided between HUD 
symbology and the out-the-window scene. Thus, when 
subjects are attending to fixed-location superimposed HUD 
symbology, unexpected events in the far domain are difficult to 
detect (Wickens & Long, 1995) and deviations from the ground 
path take longer to notice and be corrected (Foyle, McCann & 
Shelden, 1995). 

Guided by these considerations, Foyle, McCann and Shelden 
(1995) developed a potential design solution to the parsing 
problem in the form of "scene-linked symbology” - 
symbology was projected at a specific location in the scene, so 
as one moves through the world, scene-linked symbology 
undergoes the same optical transformations as real-world 
objects do, giving the symbology the appearance of being a 
real-world object itself. According to attentional theory, scene- 
linked symbology should group with the far domain, thereby 
enabling the efficient division of attention between HUD 
symbology and the far domain. 

If the altitude/path performance tradeoff found with the fixed- 
location superimposed HUD altitude gauge is an attentional 
problem, presenting the altitude gauge in a scene-linked form 
should eliminate the tradeoff. To test this hypothesis, Foyle, 
McCann and Shelden (1995) compared performance in their 
simulation when the altitude gauge was superimposed (and 
thus stationary, in a fixed location on the display) to a 
co ndi tion in which altitude gauges were scene-linked and 
located along the path, directly between the ground markers. 
Compared to the no-gauge baseline condition, performance on 
the altitude task showed equivalent improvement with the 
traditional superimposed HUD and the scene-linked altitude 
gauges. As in earlier studies (for a review, see McCann & 
Foyle. 1995), the fixed-location superimposed symbology led 
to an altitude/path performance tradeoff: The improvement in 
aititnHf. maintenance was accompanied by worse path- 
following performance. In sharp contrast, not only was the 
performance tradeoff not observed with the scene-linked 
gauges, but path-following error was actually significantly 
smaller than in either the superimposed symbology or the no- 
HUD baseline conditions. 

According to Foyle, McCann and Shelden (1995), the 
improvement in path-following performance with the scene- 
linked g a»ge< was the result of being able to divide attention 
efficiently between the scene-linked gauges and the outside 
world, something that was not possible with the superimposed 
symbology gauge. However, there are other explanations as 
well. In the scene-linked condition, 18 altitude gauges 


appeared on the path among the 37 markers; thus, the path was 
defined by a total of 55 items instead of only 37 as in the 
superimposed- and no-gauge baseline conditions. The 
reduction in path-following error may have occurred simply 
because the path was better defined in the scene-linked 
condition (termed the better-defined rath explanation). 
Furthermore, because the ground path-markers were arranged to 
define a winding path, they were seen at various locations on 
the monitor as one flew over them . As a result, the path- 
markers varied in physical screen distance from the 
superimposed, screen-centered altitude gauge. The scene-linked 
gauges always appeared directly on the path, so the screen- 
distance between the scene-linked gauges and the path-markers 
was typically smaller than between the fixed-location 
superimposed HUD symbology gauge and the path markers. 
Thus, better path performance in the scene-linked condition 
could have resulted because the altitude gauge information was 
in closer proximity (on the monitor) to path information in 
the scene-linked condition than in the superimposed 
symbology condition (termed the visual nroximitv 
explanation). 

The goal of the present experiment was to test the validity 
of these two non-attentional explanations of the scene-linked 
symbology performance benefit (i.e., not only the elimination 
of the altitude/path performance tradeoff, but better than 
baseline path-following performance with scene-linked 
symbology). Each subject flew a simulated aircraft in a series 
of short flights. On each flight, subjects were required to fly 
directly over a winding path defined by a series of equally- 
spaced ground markers and simultaneously maintain a target 
altitude of 100 ft. The two dependent measures were root 
mean square error (RMSE) deviation from the path (lateral 
offset) and RMSE deviation from 100 ft (vertical offset). The 
single independent variable, the format of the altitude gauge, 
had five levels: No-gauge baseline condition; Superimposed 
symbology (the gauge at a fixed-display location); and. Three 
configurations of scene-linked symbology. The 18 scene- 
linked symbology gauges appeared directly along the path (as 
in Foyle, McCann & Shelden, 1995), at a fixed lateral distance 
(100 ft) to either side of the path, or at a random variable 
lateral distance (50, 70, 90, 110, 130, or 150 ft) off the path 
(see Figure 1). 

The different scene-linked conditions allow us to 
discriminate between the attentional (i.e., attentional grouping) 
and the two non-attentional (better-defined path and visual 
proximity) explanations of the path performance benefits 
reported by Foyle, McCann and Shelden (1995). Following 

that study, all three explanations predict better path 

performance with the on-path scene-linked symbology altitude 
gauges compared to the superimposed symbology gauge and 
no-gauge baseline conditions. However, the three explanations 
make divergent predictions about performance with the fixed- 
and variable-distance off-path scene-linked symbology gauges. 
Because the gauges were not placed directly along the path, it 
cannot be argued that they defined the path better, as when 
placed directly along the path (as in the scene-linked on-path 



symbology condition). Likewise, the distance (i.e., visual 
angle) between the path markers and the off-path gauges was 
roughly comparable to the distance between the path markers 
and the superimposed symbology gauge. Therefore, both the 
tetter-defined oath and the visual nroximitv explanations 
predict equivalent path performance between these two off-path 
scene-linked symbology conditions and the superimposed 
symbology condition. In addition, the better-defined path and 
the visual proximity explanations predict that performance in 
the on-path scene-linked symbology condition should be better 
than in the other conditions. 
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Figure 1. Schematic drawings (not to scale) of four altitude 
gauge symbology formats (the No-Gauge baseline condition 
is not shown). 

By contrast, the attentional grouping explanation posits that 
the inherent qualities (e.g., lack of differential motion) of 
scene-linked symbology altitude gauges is the important factor 
in producing better-than-baseline path performance, not the 
physical relationship of the symbology gauges to the path per 
se. As a result, attention should be divided efficiently between 
path-markers and altitude gauges as long as they are scene- 
linked, regardless of the gauges' location. Empirically, path- 
following performance should be equivalent in all three scene- 
linked conditions, and better than in the superimposed or no- 
gauge baseline conditions. 

METHOD 

The flight simulation was controlled by a Silicon Graphics 
Indigo2 Impact computer. Images were displayed on a high- 
resolution 19-inch color monitor placed 65 cm in front of a 
chair in a sound-attenuated, dimly-illuminated booth. The 
seated subjects controlled the flight with a spring-centered 
joystick, mounted on the chair’s right armrest. Lateral 
joystick deflections controlled lateral, path-following 
movement while forward-backward deflections (down and up, 
respectively) controlled altitude. 


The flight simulation, a simple kinematic model, was pitch- 
stabilized (i.e., it did not pitch up or down when climbing or 
descending), thereby ensuring that the path information in the 
virtual environment would be visually available at all times. 
Roll was accurately depicted. The upper portion of the 
monitor was blue (representing the sky) and the lower portion 
was green (representing the ground). A white grid was 
superimposed on the ground (see Figure 1). The HUD gauge 
was a round, yellow circle with a black, clock-like arm that 
rotated to indicate altitude (after Weinstein, Ercoline, Evans & 
Bitton, 1992). In the superimposed symbology HUD 
condition, the gauge, located in the center of the monitor, 
measured 2.0 cm wide x 2.0 high cm. Items located on the 
ground (path-markers and scene-linked gauges) varied 
appropriately in size as a function of perspective. The brown 
pyramid-shaped path markers were 24 ft square by 6 ft high, 
and with the aircraft at an altitude of 100 ft, ranged in screen 
size from 0.5 x 0.2 cm to 4.0 x 1.5 cm, depending on the 
forward distance between the aircraft and the symbology. 
Similarly, the diameter of the circular scene-linked gauges was 
15 ft and ranged from 0.5 to 3.5 cm in screen size. 

All fourteen subjects were right-handed male university 
students who reported normal or correc ted-to- normal vision. 
Each was paid for participating in the experiment which lasted, 
including rest periods, about 2.5 hrs. The experiment was 
composed of 18 blocks of trials. In each block, there were five 
trials (one per HUD condition), presented in random order. A 
session thus contained 90 trials. For the first 10 sec of the 
trial, the aircraft flew in a straight-line trajectory at 100 ft — 
the target altitude - towards the first path marker demarcating 
the beginning of one of eight randomly selected paths. This 
10-sec period allowed the subject to calibrate to the goal 
altitude. For the remaining 40 sec of flight, simulated air 
turbulence caused both lateral and vertical displacement of the 
aircraft's position, thereby requiring constant monitoring and 
positioning of the craft. Forward speed, however, was set to a 
constant 160 kts. 

The experimenter emphasized the equal importance of the 
two tasks - navigate the craft over the path and 
simultaneously maintain the altitude at 100 ft — and then 
demonstrated the task by flying three trials. The subject s 
performance was viewed via a repeating monitor located 
outside of the experiment booth. For the first 30 trials, the 
experimenter provided verbal feedback via a two-way (hands- 
free) speaker system and answered questions at the conclusion 
of each trial. Throughout the experiment, after each trial, path 
and altitude RMSE scores were visually presented to the 
subject. 

RESULTS 

The first eight blocks were considered practice, and scores 
from these blocks were not analyzed. Excluding these blocks, 
each subject's path-error scores were grouped across HUD 
condition and examined for outliers. One subject produced a 
path score (330 ft RMSE) - over six standard deviations 
greater than his mean path score (with this score, M=74. 19, 




S.D.=40.29). This trial was considered an outlier and excluded 
from analysis; no other scores were omitted. For each subject, 
altitude and path scores were each averaged across blocks for 
each HUD condition; these data can be seen in Figures 2 and 3, 
respectively. Separate analyses were conducted for altitude and 
path performance. 
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Figure 2. Altitude maintenance error (RMSE ft) for the five 
attitude gauge format conditions. 
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Figure 3. Path maintenance error (RMSE ft) for the five 
altitude gauge format conditions. 

Altitude performance 

An analysis of variance (ANOVA) revealed a main effect of 
altitude gauge format on altitude scores, F(4, 52)= 18.878, 


/K.001. Additionally, Newman-Keuls planned comparisons 
(a=.05) showed there was no significant difference among the 
three scene-linked symbology conditions, 1.28 < 

1.99, <1.05(3,52), and no significant difference among 
the three scene-linked symbology conditions and the 
superimposed symbology HUD condition, 1.28 < 

2.17, qo5(4,52). Finally, a t-test comparing the superimposed 
symbology and no-gauge baseline conditions showed a 
significant difference, l(13)=4.794, pc.OOl . Thus, as can be 
seen in Figure 2, altitude performance was equal in all 
conditions with altitude gauge symbology, whether scene- 
linked or superimposed, and better than when only natural, 
perspective cues were available (the no-gauge baseline 
condition). 

Path performance 

An ANOVA revealed a main effect of altitude gauge format 
on path performance, F(4,52)=9.280, pc.OOl. Newman-Keuls 
planned comparisons showed there was no significant 
difference among the three scene-linked symbology conditions, 
2.08 < W„ IL 4.74, q. 05 (3,52). However, there was a 
significant difference between the superimposed symbology 
and the three scene-linked symbology conditions, 6.69 > 
W^. 5.19, q.oj(4,52). Finally, a t-test comparing the 
superimposed symbology and no-gauge baseline conditions 
was significant, /(13)=2.277, pc.04. Thus, path performance 
was worst in the superimposed symbology condition, but 
intermediate in the no-gauge baseline condition, where only 
natura l perspective cues were present. Performance was equal, 
and better than baseline (no-gauge) in all three scene-linked 
symbology conditions (see Figure 3). 

DISCUSSION 

The purpose of this study was to evaluate alternatives to an 
attentional grouping explanation of the performance benefits 
that have been found with scene-linked symbology. In a 
simulated flight environment, concurrent altitude and path 
maintenance performance was measured with various 
configurations of altitude gauge formats. Consider first the 
altitude/path performance tradeoff when comparing the fixed- 
location superimposed symbology and the no-gauge baseline 
conditions: Altitude performance is better with the 
superimposed symbology but path performance is worse. In 
contrast, all three scene-linked symbology conditions yield not 
only better altitude performance compared to the no-gauge 
baseline condition, but also better path performance. Thus, 
the present study replicated the super-performance benefit (i.e., 
better performance than the no-gauge baseline condition) of the 
scene-linked symbology on path maintenance found by Foyle, 
McCann and Shelden (1995). 

raider the lack of difference among the three scene-linked 
symbology conditions for both the path and altitude tasks. As 
outlined in the introduction, the tetter-defined oath and visual 
proximity explanations of the super-performance benefit of 





scene-linked symbology predicted that performance would be 
best in the on-path scene-linked symbology condition 
compared to all others. Alternatively, the attentional grouping 
explanation proposed by Foyle, McCann and Shelden (1995) 
predicted equal performance among the three scene-linked 
symbology conditions, and superior path performance with all 
scene-linked symbology conditions compared to the 
superimposed symbology and no-gauge conditions. The 
results of the study clearly support the attentional grouping 
explanation over the alternatives. 

The findings of this experiment further our understanding of 
the effects of scene-linked HUD symbology. Foyle, McCann 
and Shelden (1995) argued that scene-linked HUD symbology 
affords more efficient joint processing of the gauges and the 
world because the symbology attentionally groups with the 
out-the-window visual scene. The fact that scene-linking the 
altitude gauges removed the altitude/path performance tradeoff 
found with a fixed-location, superimposed symbology gauge 
was consistent with this explanation. It was not clear, 
however, whether the placement of the scene-linked gauges 
directly along the path played a role in eliminating the tradeoff. 
The results of the present experiment answer that it did not: 
Path and altitude scores were equivalent among the three scene- 
linked symbology conditions. We conclude that scene-linked 
aitiniHp gauges support efficient joint processing of the altitude 
information and the far domain even when the gauges are not 
located directly along the path. 

From an information processing perspective, however, a full 
understanding of the scene-linked performance benefit has yet 
to be achieved. One possibility is that scene-linking only 
encourages a partial division of attention between altitude 
gauges and the far domain, which yields a more efficient serial 
extraction of path-related and altitude-related information than 
in the superimposed condition (i.e., processing is still serial 
but with reduced switching time). Another possibility is that 
scene-linking produces a complete division of attention, 
enabling fully parallel perceptual processing of task-relevant 
information in the scene-linked symbols and the far domain. 

Still another possibility is that scene-linked performance 
benefits reflect more than just an increase in the efficiency of 
perceptual processing. Suppose that scene-linking also 
supports a cognitive integration of the two tasks so that they 
become, in effect, one task rather than two. More specifically, 
information regarding the vertical and lateral position of the 
aircraft might be combined into a single representation, which 
is then used to null both vertical and lateral error with a single 
action. Intuitively, such a strategy seems well-suited to 
produce the level of joint improvement in path and altitude 
maintenance observed with scene-linked symbology. 

This possibility is only speculative, of course, but there is 
precedent for linking dramatic improvements in multitask 
performance with post-perceptual levels of task integration. 
Fagot and Pashler (1992) found dual-task interference of 
hundreds of milliseconds between two separate responses when 
the responses were made to two separate features of a single 
object. However, when two equally distinct responses were 


made to a single feature of the object, the dual-task interference 
was virtually eliminated. Fagot and Pashler argued that basing 
both responses on the same feature enabled them to be selected 
with a single conjoint operation, thereby reducing two 
independent response selections to one. Whether the present 
results with scene-linked symbology reflect a similar 
phenomenon, or are strictly perceptual in nature, is a matter 
for future research. 
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